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ABSTRACT 

This report provides the technical results of the 
1971-72 national assessment of social studies* ,The. results are 
suiiarized across assessaent exercises for the sasple* Exhibits' 
include comparison of age for the learning area, of each of the 
National Assessment's reporting groups with the national level of 

^performance, of the various groups vithin an age, and of performance 
on subsets of social studies exercises* The reporting population and 
s^populations are categorized according to age, region of the 
country, sex, race, letel of parental education, and type of 
community* For most of the exhibits, the exercises are divided into 
the three broad themes of skills^ knowledges, and attitwdes* Chapters 
present nummary comparison data/ for exercises related to (1) the 
skills of obtaining and interpreting information; (2) the knowledge 
areas of economics, geography, history, and political science; and 
(3) attitudes' about Fir?t Amendment rights* Summary comparison data 

•are provided for the overlap exercises of the three basic 
themes — skills, knowledge, and attitudes* The last chapter includes a 
copy of the five major social studies objectives and summaries of 
group .results for each objective* Appendix A presents a 
cross-reference list *f or all exercises from theme to objective* 
(Author/DE) 
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FOREWORD 



The National Assessment of Bduc^txonal Progress (l^AEP) is an 
i^nformation-gathering project that surveys the' ediicational attain- 
ments of 9-y^ar-olds, 13-year-olds, 17-year-olds and ^dults (ages 
26-35) in 10 learning areas: art, career and occupational develop 
ment, citizenship, literature, mathematics, music , ^reading , social 
studies, science and writing. Different learning areas are 
assessed every year, and all areas are periodically reassessed in 
order to measure educational change. 

Each assessment is the product of ssveral years^ work by a 
•great many educators, scholars and lay persons from across the * 
country. Initially, th^se people design objectives for each area, 
proposing specific goals that thex feel Americans should be achiev 
ing'in,the course of their education. After careful reviews, the 
objectives are given to exercise (i-tem) writers, whose task it is 
to create measurement tools appropriate to the objectives. 

When the exercises have passed extensive reviews by subject- 
matter specialists and measurement experts, they are administered 
to probability samples from various age levels. The people who 
4 compose jthese samples are chosen in such a way that the results of 
their assessment: can .be generalized to an entire national popula- 
tion. That is, on the basis of the performance pf about 2,500 
9-year-oids on a given exer9ise, we can generalize about the 
probable performance of all 9-year-olds in the nation. 

National Assessment also publishes a^general information year 
book that describes' all major aspects of the Assessment's opera- 
tion. The reader who desires^ more detailed information about how 
NAEP designs the' sample; defines reporting groups, prepares and > 
scores the exercises and analyzes and reports the results should 
consult the General Information Ye^xrbookj Report 0Z/04-GIY . 
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Many people have made substantial contributions to^ the social 
studies assessment/ from the beginning of the National Assessment 
of Educational Progress (NAEP) in 1964 to completion of this tech- 
nical repprt. Unfortunately, it is not possible^ to acknowledge 
them' all 'here, and an apology is due to those whose names have 
*been omitted* . * - J 

' J - . \ 

• The original preparation of the objectives and exercises in 
the area of social studies was"" handled by thfe Educational Testing 
Service (ETS) . Additional - exercises in the attitudinal domain 
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Michigan, for his consultation throughout all phasep of the assess- 
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Special assistance throughout . the assessment was provided by Susan 
Sullivan, and programming support was provided by William Ankeny, 
both of the Data Processing Department, Thanks are also given to 
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Assistants, iTtilization/Applications Department., Janet' Bailey , 
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* CHAPTER 1 
THE SOCIAL aTUPIES ^SSESSMiINT 



" . Prep^aration' for the social studies assessmer^t began in the 

fall of ^965, when^ a panel pf professionals convened to identify ' 
> 'the objectives of social studies education. It was generally 
" recognized that the domain of the social studies is almost limit- 
/ l6ss. Recognizing that it would be difficult to identify object-- 
ives that would be- unanimously accepted,, th^ committee decided to 
define the ob^ectiV^es. in terifts 6f -what was taUght in th^ schools. 
A€ter extensive review a set of objectives was accepted, ^nd exer- 
cise development began in 1966. Throughout the next years many 
exercise-review conferences were held and,"* in the fall of 1970, 
all of the, social .sttidies exercises were reviewed by the U.S. 
Office of Education. Social studies was assessed together with 
music. The exercises ,were packaged and printed , and the admin- 
istration took plade during 1971-72. After ^the administration, 
ail open-ended -exercises w$re scored by trained personnel. . 
Exercise-by-exercise results and summary data were then compjjted 
by the National Assessment of Educational Progress_(NAEP) staff. 

National Assessment has made^ these data available -in various 
/reports. A. general discussion of the sbciaj. studies results can 
be found in Thq First Social Studi^4 Assessment: An Overview ^ 
^Report OZ-^SS^OO. -For those interested in the specific text and " 
results fQr the exercises summarized, detailed exercise-by-exero4/se 
documentation is j^rovided in the Social Studies Teohnioai' Report: 
Exercise Volume^ Report OS-SS/BO^. Data is included for all exer-r 
cises, but the exact exercised text is provided for only the \ 
released exercises. Some exercise te^ts ace unreleased at this 
time because National Asses.sment will administer these same exer- 
cises again in five years to determine whether The performance 
level of Americans has improved or declined. 

Focused reports are Volitical Knowledga and^ttitudes ^ \ 
Report OS^-SS^pl and Contemporary Social Issu^Sj Repor>t 0S-SS'02\ 
In addition, /National Assessment has produced computer data -tapas., 
which contain the response data gathered in the social studies \ ^ , 
assessment. State and local educators wh6 wanf^to use National ' ' 
^As'sessment ex^rcis^s in their own assessment programs, as well as 
others interested in more information, should find these additional 
reports and documentation useful. 
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Purpose of the Technical Sununary 

The purpose of this report is to doctiment the results of the 
1971-72 assessment of social s.tudiesl The dat'a ia this^^ Volume are 
not presented exercise by exercise. Results are suInmaxized-aGXOS5L„- 
exercises for groups of people. Exhibits rin^Tude age " comparisons 
for the learning' area^ comparisons 'of each of National Assessment's 
repotting groups with the -rtational level of performai\pe, compari^ 
sons of the varioiiS--'^foups within an age and comparisons of per- 
formance on sutSets of social studies exercises. An effort was 
made to sturtmarize the data in ways that provide useful and inter- 
estijag^omparisons. The data can be used to identify the strengths 
^ndweaknesses of various groups of people. , For example,* this 
volume pxnesents data comparing male-female performance across 
four age'J^evels on social studies knowledge, arid attitudes. Pier- 
formance of inner-city children is given for each objective 
measured, and results comparing regions of^'the country with 
naticmal performance are also included. Sometimes patterns' emerge • 
t'hat s'an form the basis for judgments and decisions about the 
direction of social studies education. 

« • 

A description of National Assessment's sample design and the 
groups of people for which results have been summarizea^is pre- 
sented later in this chapte|b. An explanation of how various types 
of exercises have been clustered fpllows. 



How the Exercises are- Cla-ssified . 

As mentioned above, the data included in this volxime summa- 
rize results for certain subsets qr clusters of exercises. 
National Assessment has worked' Closely with sub ject-iftatter specia- 
lists in making these decisions. The social studies^ exercises 
have befen clustered in , two different ways , by themes and by objec- 
tives.- For most of the' exhibits in this report, the' exercises 
have been divided into three broad themes — skills, knowledges- . 
and attitudes. An outline of the types of exercises thafe were 
classified into these themes follows. 

I*. Skills * ^ ' 

A. Obtaining information 

1/ Raises questions and seeks answers related to a 
variety of issues 

2. Identifies sources most suitable -to solve a particuj 
. lar problem or find particular information 

3. Uses standard reference sources and aids to locate 
information 

' ' B. Interpreting information 

1. Uses basic 'problem-solving techniques of the social 
sciences to interpret information of various kinds 



2, Interg>'rets graphs and, maps effectively* 
'3. Uses a variety of nontradi1;ional sources of informa- 
tion * " . * 

. ' , • • * 

II. Knowledges * ' 

A. Economics * * * ' 
' 1. Understands ?ome of the basic characteristics of • 

economic systems that are common to- all industrial 
societies - . • • 

B. Geography • • 
.1. Has knowledge of worldwide spatial distribution 

and interrelationship of the major . features of man's 
physical and cultural environmeyat 

C. . History > 

1. Understands some of the major developments in U.S. / 
history . * • ^ • / 

2. Understands some of ^ the major developments in 
/ • * world history ' • . • 

D. Political science » 
1. Knows some of the indi\riduals and groups responsible 

for making government decisions • 
- . 2. Understands some of the rigl^ts and responsibilities 

granted in the Coi\£titution 

3. Knows somethxAg about the ^irfection' process^ and the 
rgrle of political, parties ^ . t. 

4. Understands some of the processes involved in 

■ ' ^ political sodaiization p 

III. Attitudes 

A. Rights of the 'First Amendment 

1. Believes in the freedoms of the First Amendment and 
can justify that belief ' ^ - * 

B. l!he worth of the individual 

1. Believes people should become*'involved in making 
decisions that affect their lives * ' ' 

2. \ Has a sense of responsibility for the interest of 

, others ' * • 

3. Respects the views and feelings of alL people* 

4. Believes in the rule of law and can justify that 
belief \ , ' 

Chapter 2 presents summary data for the exercise^ classified 
in the skills theme, Chapter 3 presents data for exercises clas^ • 
sified in the knowledge theme and Chapter 4 presents data, for 
exercises classified in' the attitudes theme.* Chapter 5 summarizes 
across themes. 

Chapter 6 includes a copy of the five'm^jor social- studies ^ 
objectives and summaries of group results for each objective. 
Appendix A presents a cross-reference list for all exercises from 
theme to objective. 
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Sampling - \^ 

The exercises were given to a national probability sample of 
9-year-oids, 13-year-olds, 17-yeaf-olds (including high school 
dropouts and «arly graduates) and* young adults between the ages 
of 26 and 35.-^ Within the four age. levels, National Assessment 
can report data about a limited number of subpopulations . 
Although the same included respondents" from. all 50 states and the 
District 6f Colombia, it was hot of sufficient size to enable: 
comparisons of, the data between states / school districts, schools,, 
teachers, etc. 

The sample design employed, by National Assessment was strati- 
fied by geographic region, st^te, size of communj^ty and socio- 
economic levjel. The sample was drawn at three stages. The first- 
sta^e sampling units consisted of counties or groups of contiguous 
counties and wa3 constructed using U.S. Cejisus- data on the numbers 
of persons living in those counties. 

For the in-school assessment, a stratified' random sample of 
primary sampling units (PSUs) was drawn. Lists, Avere made of the ^ 
schools in each selected unit. At the second stage, a sample of 
s^phools was selected within each PSU. Finally, within each 
selected school NAEP drew a random sample of 'students, and assigned 
those students to assessment booklets. Of course, all student 
listings were destroyed to protect the anonymity of the respondents. 
Nationc^l Assessment has no recoi^ of the names of the students 
who .took the booklets. The out-of-school samo^le design was similar 
to the in-school design. First, primary sajnpling units were drawn. 
Then, within each PSU a sample of* small-area segments was obtained. 
Specially trained administrators- located assessment part^icipants 
within' the' area segments by visiting each housing unit and deter- 
mining if any individuals of the appropriate age lived, tliere. Of 
the eligible individuals, 84% participated in the sooial studies 
assessment. - * 

About 90,000 respondents were sampled in the 1971-72 assess- ' 
ment. However, not till respondents took all exercises. For 
example, 25,500 13-year-olds participated in the social studies 
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^An overview of*the National' Assessment sampling design tor Years 03 and 04 is 
provided in .Chapter 2 of the General Information Yearbook^ Report 03/04-Gn 
(Washington', -DTCr: Government Printing Office, 1974). For more detailed >^ 
documentation, see J,R. Chromy et al.. The national Assessment Approach to 
Sampling (Denver, Cold.-: Education Commission of the States, 1974). For an 
introductory treatment aimed at state and local assessment problems, see R*I1. 
Jaeger, A Primer 'on Sampling for Statewide Assessment (Princeton, N.J.: „ 
Educational Testing Service, Center for Statewide Educatlonni Assessment, 1973), 



' ' . • 1 i 



assessmeni:. Between 2,200-2/700 13-year-olds responded to each 
booklet o£ exercises u ^ . . ^ 

Reporting Populations and Subpopulations 

'In addition to national results for g-year-plds, 13-year- 
old3, 17-year-olds and young adults, National Assessment- provides 
data about various groups of people. The variables used for this 
analysis are region of the country, sex, race, level of parental 
education and size and type of community. They are defined as 
follows. . ' 



Region _ * , • 

The country has been divided into four regions — Northeast 
(NE) , Southeast (SE) , Central (C) and West (W) ~ in order to 
'present results for various regions relative to the national 
results . 
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Sex 



Results are presented for males (M) and for females (F) • 

Race , ... / 

Results are presented for whites (W) and blocks (B) • 

♦ 

Parental ^Education ♦ j» 

The tour parental-education categories are <3ef ined> Ijy the 
highest level of education attained by either of a person's par- 
ents, The no-high-school (NHS) category, is comprised of all 
people who indicated that neither parent went to high school. The 
some-high-school (SHS) category consists of all those who indi- 
cated that the parent with the,,most education attended high school 
but did not graduate. In the graduate4-f rom-high-school -{GHS) 
category are all those who indicated that at least one patent 
graduated from high school, and' in the post-high-school (PHS) 
group are all those who indicated that at least one parent received 
some education past high school (college, vocational training or * 
adult education' c6urses) . v ^ 

Size and Type of Community (STOC) 

The groups within this variable ^re defined by the size of a 
person's community "ali^.,..,.^!!^ occupat profile of the area his or 

her school Serves. ^^-^ • ' 

Extreme vuval (ER)1 People in "tfTl^s^^^oup attend schools *ia , 
a community having a population less than aboa^ ^^,000. Mos't 
residents in the are^ the school serves are farmer^N or farm 
workers. 

• ' Low metro (LM) . Individuals in this group attend schools 
within the city limits or residential ar?,a served by a city with 
a population greater than 150,000; the schools serve areas in 
which a high proportion of the residents are on welfare or not 
regularly employed. 

H'igh metro (HM). Individuals in this group attend sch6ols 
within the city limits or residential area served by a city with 
a population greater than 150,000; the area served by the school 
consists primarily of residents who, are professional or managerial 
personnel. v* 

Urban fringe (UF). People in this group aj:tend schools in 
the metropolitan area .served by a city with more than 200,000 



inhabitants; the school and the area it serves are outside of the 
city :}iimits and are not included in either the low-meftro" or high- 
metro group. 

V 

Main big city (MBC) . These are students attending schools' 
in a big city {population great^ than 20 0,0 00 > who are not 
included in either the low-metro or high-metro groups. * 

r I 

Medium city (MC). Individuals in this group are those who 
attend schools in cities with populations between /25 , 000 and 
.?00,000 that are not in high- or low- metro groups. 

Small places (SP). People in this group attend schools in a 
community of less than 25,0 00 inhabitants, which are not included; 
in the extreme-rural group. 

Data Analysis 

National Assessment weighted the data in accordance with the 
sample design and estimated the percentages of individuals in the 
population who possessed various knowledges, understandings, 
skills and attitudes. 

To do so, NAEP has developed two bkseline measures. 

1. F^Value. An estimate of the percentage of persons in 
each of itlie populations who gave a certain response to 
a specific exercise. For example, the estimated percent- 
age of 9-year-olds who answered a given exercise accept- 
ably is, defined as the sum of the* weighted number of 
acceptable responses divided by .the sum of th,e weighted , 
number of responses for all 9-year-olds. Percentages 
for each reporting group were computed in the s^me 
. manner using only the ^weighted responses for ' the .people 
in that group. * ^ ^ ^ 



2. / t^P-Value. An estimate 'of the differences between the 
^ performance of a subpopuiation and the performance of 
the total age population. A Ap-value is. the difference 
b^etween the estimated percentage of a group (for example, 
the Western region) that provided a particular response 
to an exercise and the corresponding national percentage: 

Western - National % = Western AP-Value. 

\ If, on a given exercise, a group's percentage is lower 
\ than the national percentage, the difference between the 
\ two percentages is expressed as a negative number; if a 
group's percentage of success is higher than the national 
percentage, the group's difference in p'erformance is a 
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" ^positive nuinber. For excunple, " iNf on a given exercise 74% 
of the 13-year-olds in the West gave aa,-at:ceptable 
response, but only 68% of the national' sample did so, 

' then the West ^p-value for i3-\^ar-olds would be +6 
percentage points. ^ -^"^7 \^ 

National Assessment used both ^f these measures for summary 
analysis.' * - , ^ 
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By looking at ah exhibit of p-values (see above) , the range 
of percentages for the ne^tion and/,each reporting- group, for a given 
set of exercises can be studied and compared. Each black square 
represents one exercise ot exercise par€.' Each distributi0lnjj.-^of 
exercise results is also accompanied by the following' information . 

1. Median P^Vatue (•^). When the p-values for a set of 

exercises have been rank ordered, middle p-value. For 

! N+1 
an odd number of p-values, the median = "y^th p-value. 
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For an even number of p-values, the median == P*" 

v.alue + 1^^^ p-va-lue) • 

2. Hinge P-yalue (^) * Similar to quartile. Divide the 
rank-ordered p-values into two sets at the median (for 
an odd number of p-values, the median p-value is a member 
of both sets) . The upper and lower hinge's are the 
^medianV of those sets. 

< 

For a given, set of exercises^ a group's achievement relative 
to national level* of achievement can also be summarized using 
differences from national percentages of succesis. One table of 
median Ap-values^ is included in Chapter 5 of this report.'. A 
definition follows. 

Median i^P-Value. When the Ap-values have been 
- rank ordered from positive' to negative values, 
the middle Ap-value. For example: If on a 
set of 5 exercises the percentages of sftccess 
for , all 9~year-olds were 90%, 40%, 82%jr75% and 
60%, jand the percentages of success for a , * 

particular group — Northeast ,9-y|6ar-olds , 
for instance, — on these same exercises ^were , 
respectively, 95%, 44%, 85%, 77%, and 61%, 
then the group's differences would be +5%, 
+4%, +3%, +2% and +1%. The group's median 
difference from a national performance level — 
that figure above and .below which 50% of its 
exercise difference's lie — would be +3%. 
If more than 12 e^cexcises Rr^_,sumina^ 
the median difference provides a stafcle indi- 
cator of a .typical performar!^!l^over 

the set of exe^ises. 

• All exhibits in this report are accompanied by information 
tha^ tells the number of observations (p-values or Ap-values) that 
were used in the analyses. Each single-part exercise contributed 
one p-value (one observation or black box) to the summary - analyses 
For some multipart exercises, sub ject-matter- specialists and 
educators decided that respondents must^ have all parts acceptable 
in order to achieve an- acceptable performance level on an exer- 
cise. Othe^ multipart exercises were anal^yzed as if each part 
:,was a separate exercise . " ^ ^ 

Limitatiorrs^ of the Data . 
, i. ' ' 

Clearly., neither this booklet, nor future Assessment reports, 
will answer all the questions people have about the effective- 
ness of social studies education. Hov/ever, data is provided about 



iC 



specific groups of exercises, and these data can be used to make 
generalizations about the results of social studies education. 

« 

Interpretation of the data is. a diffiault process. The 
results may prove encouraging from one perspective, discouraging 
from another, - Much of the data may only confirm what the readers 
might already suspect,, but documentation itself is a positive 
and important step. Each reader will have to assimilate thedata 
to draw his own conclusions. It is our hope that this assessment 
will raise and encourage questions) promote widespread discussion^ 
serve as a stimulus for further research and help ,raise the quality 
of social studies education in America. , • 
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CHAPTER 2 
SKILLS THEME 



The exercises summarized in this chapter attempted to measure 
skills related to obtaining , and interpreting information. For 
example^ exercises required responclents (1) to use a card cata- 
logue, (2) to select the correct source of information to learn 
about news during the last 24 hours or the early settlement of 
their state, (3) to read tables, maps and graphs and (4) to dis'- 
tinguish fact statements from opinions.^ 

"the fir^t summary graphs in this chapter, pages J3^16, depict 
the range of percentages for the nation and each group for the 
exercises clustered in the skills theme. Median p-val'ues are 
^designated with an and hinge p-values with a 1^ . The first 
exhibit shows percentages for the various reporting groups of 
9-year-.olds; the second" exhibit shows percentages for 13-year->^ 
"olds; the lAiird, for 17-yea'r-olds ; and the fourth, for young 
adults. , * ' ' 

:^r example, on page 13 It can be seen tha't 9-year-old per- 
centages fop the nation as a whole range from 36-% to 96%. Their 
median "petrceivtage is 74%. The range of the middle 50% of the 
exercises is between the lower hinge of 61% and the upper hinge 
of 80%. * group's typical performance is indicated by .its median 
percentage and t*he r^nge of the middle^ 50% oi its exercise per- 
centages. 'So it can be seen ^that the Northeast typically per- 
formed somewhat above the nai:ion on these exercises. Their median 
percentage* is. 79%,' and the range of the middle 50% of their exer^- 
cises is between 7-0% and 85%. 

To determine .{the contend: of specific exercises, readers, can 
cross .reference with The First Social Studies Assessment: An 
Overview J Report OZ-SS-00 and the Social Studies Technical Report: 
. Exercise Volume^ Report az-SS-20. For example, by looking on page 
12 of The First Social Studies Assessment: An Ovei'view it can be 
seen that the '36% exercise for the national sample of 9-year-olds 
dealt with translating information found in a table of contents. 
The exac/t text of this exercise is located in the Social Studies 
Technical^ Report: Exercise Volufhe . 

When interpreting the group data ^n these exhibits, all the ^ 
variables influeincing the educational process mnst be considered. 
Within the limitations due to measurement and sampling error,' the 
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data accurately describe the educational achievements of the 
groups designated in our sample. However, when the data show that 
a group's overall level of achievement is either above or below 
the national level , we cannot say ^that any difference in achieve-^ 
ment between that group and the nation as a whole is attributable' 
solely to membership in that group'. 



1,2 

19 




21 



$ 



'^Overlap Exercises ♦ 

The preceding exhibits enabled comparisons between groups 
Within an age. However/ all four age levels were not asked to 
resfcpond to all th'e exercises.* In some cases an exercise was 
administered at only one age, for example, 9-year-olds. Others * 
were gfven at two or more age levels and are called overlaps. 

Cross-age anadyses can be made by comparing the national and 
group percentages of exercises taken at more than one age level. 
In the social studies assessment, 9-year-old exereisesdif f ered 
considerably from exercises given at the older ages. We can. 
compare th6 performance of 13-year-olds, 17-yeaj:-olds and young 
adults, since 36 of the same exercises were given to these three 
age levels. * , , . 

Pages 19-24 contain summary graphs depictin.g cross-age com- 
•parisons for the social studies ^exercises in* the skills theme. 
There' is an exhibit for each reporting category comparing the 
three ages for the reporting groups in that categoty. Thfe first 
dilsplayg regional comparisons; the second, male and female com- 
parisons; the third, black and white comparisons; the fourth, 
parental-education comparisons-; and the fifth and sixth, compari- 
sons^ by size and type of community. Each exhibit also includes 
national percentages for the three age levels as a point of refer- 
ence. ' 

,The' range of percentages^ for each age level is represented by 
the dotted- vertical lines (see the following graph) . Median p- - 
values are noted below the graph for each age, as veil as con- 
nected by a solid line on the graph. It can be seen 'that the 
median. percentage on the skills exercises was 70% for 13-year- 
olds, and 80% for 17-yearTolds , an increase of 10%. The median 
percentage for adults decreased to 76%. Upper and lower hinges 
are connected by dashes. For each age level, the distance between 
the dashed lines indicates the range of the middle 50% of the 
percentages for that age. . ^ 
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CHAPTER 3 
KNOWLEDGE THEME 

The ej^ercises summarized in this chapter attempted to measure 
knowledge about economics, geography^ history find political sci- 
ence/ For example, exercises required. respondents to (1) under- 
stand credit purchases, (2) know the location of major rivers, • 
(3) name three problems facing large cities; (4) know some rela- 
tionships between man and his environment, (5) understand the role 
of the United Nations and (6) understand the s.tructure and know * 
some functions of the three levels of government. 

The first summary graphs in this chapter, pages 27^30/ depict 
the range of percentages for the nation and each group, for the 
exercises clustered in othe knowledge theme. Median p-values are 
cTesignat^d- with an and hinge p-values with a ||^ . The first 
exhibit shows percentages for the various reporting grbups of 
g-year-olds; the second exhibit shows percentages for 13-year- 
'olds; the third, for i7-year-olds; and the fourth, for young 
adults . ' 

For example, on page 27 it can be seen that 9-year-old per- 
^ centages for the nation as, a whole i;^nge from U% to 97% . Their 
median percentage is 58%. The range of the middle .50% of the 
exercises is between thfe lower ^h^nge of 40% and the upper hinge 
of ,79%. A group's typical performance is indicated by its median, 
percer>tage and the' range of the middle 50% of its exercise per- 
centages. So it can be seen that the Northeast typically performed 
somewhat above the nation on these exercises. Their median per- 
^ceritage is 62%, and the range of the middle 50% of their exercises 
is between 44% and 83%. . * 

^ 4 ^ 

To determine the content of specific exercises, readers can 
cross reference with The First Social Studies Assessment: An 
Overview^ Report OS-SS-OO and the Social Studies Technical Report: 
Exercise Volume^ Report OZ-SS-BO. For .example, by looking on page 
!3:2 of The First Social Studies Assessment: An Overview it can be 
se^n that the 0% exercise for the national sample of 9-year-olds 
.'4ea?Jt with naming, two famous Oriental Americans., The exact text 
•of this exercise is located in the Social Studies Technical Report: 
}Exerci'Be Volume* « 

Wh^ interpreting the group data in these exhibit"^ all the 
variable^ ijifluencdng the^ducational process must be considered. 

25 

o ' ' 32 ' ' ■ 



ERIC 



V 



Withivii the limitations due*^ to measurement and sampling error, the 
data < accurately describe the educational achievements of the groups 
designated in our sample. However, when the data show that a 
group's overall level of achievemervt is either ab6ive or below the 
national level, we cannot say that aity 4,if ference in achievement 
between thkt group and the nation as a whole is attributable, 
^solely to- membership in that group. 
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Overlap Exercises . 

*• « 
The preceding exhibits enabled comparisons between groups 
within an age. However/ all four age levels were not asked to 
respond to aj.1 the exercises. In some cases an exercise was 
administered at only one age, for example, 9-year-olds. Others 
were given at two or more age levels and are called overlaps. / 

Cross-age analyses can be made by comparing the natiional 
and group percentages of exercises taken at more^than one age 
level. In the social studies assessment, 9-year-old exercises 
differed considerably from exercises given at the older ages. We 
'can compare the ^)erformance of 13-year-olds, 17-year-olds and, 
young adults, since 65 of the same exercises were given to these 
jtKree age levels. 

.Pages 33-38 contain summary graphs depicting cross-age ""com- 
parisons- for the social studies exercises in. the- knowledge theme. 
There iS-. ah exhibit for each reporting category comparing the 
three ages for the reporting groups in that category. The first 
displays re^ionai comparisons; the second', male and female com- 
parisons; the third, blacky and white comparisons; the four'th, 
parental-education comparisons; and ^ the fifth and sixth, compari- 
sons -by sdze and type of community. 'Each exhibit. also includes 
nationaL percentages for the three age levels as a point of refer- 
ence. 

* The range of percentages for each ag§ level is represented by 
the dotted vertical lines (see the following graph). Median p- 
valufes are xjoted below the graph for each age, as well as connected 
by a solid ':line on the graph. It can be seen that the median per- 
centage on "the knowledge exercises was 60% for 13-year-olds and 
72% for 17;^year-old^ an increase of 12%. The median., percentage 
for adults* was also 72%. Upper and lower hinges are connected by^ 
dashes. For -each age level, the distance between the ^dashed 
lines indicates the range of the middle 50% of the percentages for 
that age. 
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CHAPTER 4 

ATTITUDES THEME \: 

^ " - ■ . ' ■ ". . ' „ ^ 

^'The exercises summarized in this chapter attempted to measure 
attitudes toward First Amendment rights and attitudes about self ' 
and others in a democratic society. For example^ exercises 
required respondents to indicate their opinions about picketing^, 
petitioning and freedom of the press. Other exercises asked 
about; class consciousness, conformity to peer pressure and will- 
ingness to make decisions in school. 

The first summary graphs in this chapter, pages 41-44/ depict 
the range of perceAtags for the nation aijd each group for the exer- 
cises clustered in the attitudes theme Median p-values ar^ des- 
ignated with an and hinge, p-values with a |||, . The first exhibit 
shows percentages for the various reporting groups of 9-year-olds; 
the second exhibit shows percentl^ges for 13-year-olds; the third, 
for 17-year-olds; and the fourth) for young adults. , 

> For example) -on page 41 it can be seen that 9-year-old per- • 
centages for the nation as a whole range froiij^ 27% to 98%. Their 
median percentage is 78%. The range of the middle 5p% of the 
exercises is between the lower hinge of 72%r'and the upper hinge of 
Sl%. A group's typical performance is indicated, by its median 
percentage and. the range of the middle 50% of its exercise percent- 
ages. So it can be .seen that the Northeast typically performed 
somewhat above the nation on these exercises. Their median per- 
centage is 81%, <and the range of the middle ^50% 6f their exercises 
is between 74% and 83%. ' . 

To determine iLhe content 9f specific exercises, readers can 
cross reference with The First Social Studies Assessment : An 
Overview^ Report 03-SS~0.Q and the Social, Studies Technical Report: 
Exercfise Volume^ Report OZ-SS-20. Fbr example, by looking on 
page 53 of The First Social Studies Assessment : An Ovenview it* 
can be seen tjiat the 27% "exercise for the national sample of 
9-year-olds dealt with . class consciousness . The exact text of 
this exercise is located in the- Social Studies^ Technical Report: 
Exercise Volume. 

When interpreting the group data in« these exhibits, all the 
variables influencing the educational process must be considered. 
Within the limitations due to i^^asurement and samp^ling error, the 
data accurately describe the educational ' achievements of the groups 
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designated in our sample. However, when the data show that a 
group's overall level of achievement is either above or below the 
national level, we cannot say that any difference in achievement 
between that group and the nation as .a whole is attributable 
solely to membership in that group. 
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Overlap Exercises 

The preceding exhibits enable^ comparisons between groups 
within an age. However, all four age levels were not asked to 
respond^ to all the exercises. In some cases an exercise was 
administered at only one age, for example, 9-year-olds. Others 
were given at two or more ag§ levels and are -called overlaps. 

Cross-age analyses can be made by comparing the national and 
'group percentages of exercises taken at more than one age level. 
In the social studies assessment, 9-year-old exercises, differed 
considerably from exercises given at the older ages. We can 
compare the performance of 13-year-olds, 17-year-olds and young 
adults, since 15 of the same exercises were given to these three 
age levels. 

Pages 47-52 contain summary graphs depicting 6ros$-age com- , 
parisons for the social studies exercises in the attitudes theme* 
There is an exhibit for each reporting category comparing the 
three ages for the reporting groups in that category. The first 
displays regional comparisons; the second, male and female com- 
parisons; the third, black and white comparisons; the fourth, 
parental-education comparisons; and the fifth and sixth, compari- 
sons by size and type of community. Each exhibit also includes 
national percentages for the three age levels as a point of refer- 
ence . 

The range of percentages for each age level is represented by 
the dotted vertical lines (see the following graph) . Median p- 
values are noted below the graph for each age," as well. as con- 
nected by a solid line on the graph.' It can be seen that the 
median percentage on the attitudes exercise was 64% fojp 13-year- 
olds and 80% for 17-year-olds, an increase of 16%. The median 
percentage for adu^^ts decreased to 73%. Upper and lower hinges 
are connected by dashes. , For each age level, the distance between 
the dashed lines indicates the range of the middle 50%* of the per- 
centages for that age. 
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CHAPTER 5 
SUMMARIES ACROSS. THEMES 

- * » 

A 

Th^ first exhibit iri this chapter compares (Overall national 
results for the fqur age levels on the three themes used in the 
analysis of the social, studies data. For each .age, the exer- 
cises within each of the themes have been rank«i ^rom highest to 
lowest percentage of success; the median perceniage, upper-hin^e 
percentage and lower-hinge percentage have been identified. 
This graph can be used to establish the relative performance 
levels for the skills # knowledge and attitudes .-themes for each 
age level. ' Direct comparisons of percentages across age levels 
should not* be attempted because of the 4iff®^^®i^t numbers of exer- 
cises \involved, " * 

Ti\^ second exhibit in this chapter is a table of median Ap- 
values fox each of the reporting groups. Results are disp"Myed 
by age fpr each of the three themes r as well as the total imi verse 
of the social studies, exercises . The national median p-valu^^^and 
number of exercises is also included for each theme. V\ 

A. negative percentage indicates that a group's performap.ce 
was typically below the nation; a positive percentage i,ndi<?^tes 
;that a group • s*^ performance was typically above the nation.^ For 
example, the* median Ap-value for 9-year-olds in the North^st on 
the skills theme 'is 3.8%, The 9-year-olds in the Northeast 
typically performed at^ove the national level, and tti^ median per- ^ 
centage at the national level was 74.3%., These two^/fiercentages 
cannot be added or subtracted since both are the result of a rank- 
ordering^ ^process^ r-r^-j^ne- ^y^^ P the other by, Ap-values . 

Since these rank orderings depend on the -percentages and not the 
exercise, it is unlikely that these two percentages result from 
the same exercise. However, these two percentages do describe 
the typical performance o^ each group in terms of the national — 
level of performance, as we^ll as indicate how the nation tended 
to perform on the sa^ie set of. exercises. It is important to 
recognize that although reported' differences do exist and must be 
faced,, membership in any of these groups should not he assumed to 
be the cause' of a group's performance. 

The majority of this chapter is devoted to cross-age analyses 
on the overlap exercises within each of the three themes. These 
graphs summarize the overlap information contained in Chapters 
2-4. There is an exhibit for the nation and for each reporting 

53 

> ^ 'GO O 



group comparing 13-year-olds ^ 17-year-olds and young adults for 
the- skills theme, knowledge theme and attitudes theme. Since 
many exercises administered at the older ages were not considered 
suitable for 9-year-olds, not enough exercises overlapped at 
age 9 to allow comparisons for that age level. 

The graphs containing overlap information can be used, to 
determine the relative strengths and weaknesses of the three age 
levels^ on the three themes for each of National Assessment's 
reporting g'roups. The range of percentages for each Of the age 
levels is represented by the dotted vertical lines.. Median 
p-values are connected by a solid line on the graphs and upper and 
lower hinges are connected by dashes. Median p-values for the 
nation and the. group are noted below the graph for each age. For 
exeunple, the graph on page 58 indicates that for the Northeastern 
region, 17-year-olds consisti^tly perform above the level of 13- 
year-^olds. The typical performance levels for 17-year-olds and 
young adults on the knowledge exercises are quite similar. How- 
ever., on the exercises involving skills and attitudes, the* adult 
performance typically tends to be below the performance level of 
17*year-olds . 
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CHAPTER 6 



SOCIAL STUDIES OBJECTIVES^ 



The objectives and subob jectives developed ^or^ the 1971-72 . 
social studies assessment are listed below* 

I. Have curiosity about human affairs 

A. Raise question^ and seek answers 

B. .Are open to new information and ideas 

C. Try to understand why other people think and act as 
they do * 

II. Us e analytic-scientific procedures effectively 
A. Identify and define problems and issues 
,B. Formulate generalizations and hypotheses capable of 
being tested 

C. Obtain information from a, variety of sources 
^ D. Distinguish facts from opinions, relevant from irrele- 
vant information and reliable from unreliable sources 

E. Detect logical errors, unstated assumptions and unwar- 
ranted assertions; question unsupported generalizations; 
are aware of the complex nature of "social causation 
and understand that sequence or relationship does not 
necessarily imply causation 

P. Use data and evaluate criteria to make decisions 

III. Are sensitive to creative-intuitive methods of explaining 
the humari' condition ;^ 

A. Read history, philosophy and fiction 

B. Obtain insight into human affairs from history and^ 
philosophy, and from fiction and other forms of art 

C. Recognize the role of creative-intuitive methods in 
scientific inquiry 

D. Distinguish personalized explanations of human affairs 
from scientific-objective explanations 



detailed description of the procedures used to develop the objectives for 
the 1971-72 social studies assessment, as well as the objectives, subobjectives 
and the age-specific behaviors Illustrating each subobjective, can be found 
in Social Studies ObjectiveSj 1971-72 National Assessment of Social Studies 
(Denver, Colo'.: Education Commission of the States, 1970). 
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ly. Have knowledge relevant to the ma]6r ideas and concerns of 
/ social scientists ' ; 

^ A. Understand some of the distinctive modes of inquiry 
(questions and approaches) of social scientists 

B. Understand some of the major relationships involving 
culture, the group and the self 

C. Understand some of the major characteristics of economic 
systems, especially the American economic system 

D. Understand some of the major characteristics of the 
geogxapHic (spatial) distribution of man and his activi- 
ties, and of man's interaction with the physical 
environment 

A E. Understand some of the major historical developments 
P. Understand some of the characteristics of the major 

systems of government, particularly the political system 
of the Ignited 'States 

V. Have a reasoned commitment to the values that sustain a 
free society 

^ A. Believe in the fundamental worth of the individual and 
can justify their belief 

B. Believe in the freedoms of the First Amendment and can 
justify their belief 

C. Believe in the rule of law and can justify their belief 

D. Believe in open opportunity for advancement and can 
justify' their belief 

£• Are willing to act for the general interest 
F. Are willing to participate in decision making relevant 
to their lives 

Some exercises wefre developed to measure each of the five-^ 
major objectives at^ the four age levels included in the assess- 
ment. However, exercises measuring the objectives often varied 
in content and numbers afcross age level's. Also certain subobject- 
ives were felt to be , inappropriate for one or more age levels, so 
there are not measures for all subobjectives for all four ages. 

The first exhibit in thijs chapter summarizes each reporting ^ 
group's performance , far the five major objectives. Median p- 
Values are presehted for exercises that were given to IS-year- 
olds, 17-year-olds and young adults. As mentioned earlier, not 
all objectives ahd subobjectives received equal assessment 
CTTiphasis across ages. Therefore, not all exercises were given to 

ag^s. Exercises that were given at more than one age are 
called overlap exercises. Because of • the nature of the social 
studies objectives, many exercises were different for 9-'year-olds . 
However, a number of, exercises were suitable for administration 
at all three of the older age leyels. 

Since the exercises analyzed are the same for all. the groups 
and the ages, the median p-values can be used to determine the 
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relative performance of the reporting groups^ and the ages for afny 
given objective. For example^ the median performance level of 
Northeastern 17-year-olds is^ almost 20% above the median perform- 
ance level of 13-year-olds. The median performance level of 
17-year-olds is also above that of adults. It can be seen that 
this pattern is also present for the Southeast. However , the 
Southeast median percentages are consistently below the Northeast 
median percentages — almost 20% at a^e 13. The comparisons can 
be continued until generalizations can be made^ i*e.r. 17-year- 
olds typically perform above 13-year-olds. Since 12 observations 
are necessary to provide stable estimates r some caution should 
be exercised in interpreting the data provided for Objective III. 
Objective I data should not be used as the basis of generaliza- 
tions and^is provided only for general interest. 

' The rest of the graphs in this chapter are based on an 
analysis of all the exercise's measuring an objective, at a given 
age level. There is an exhibit for each age summarizing national 
and group .performance on each objective. Objective I information 
ordered by age is presented first, followed by Objective II infor- 
mation and so on through Objective V. 

Each graph can be used to determine , for an age level , the 
relative performance of the reporting groups within each category # 
as well as the relative performance between each group and the 
nation* - Each- black square represents an exercise or exercise 
part. The range of percentages for each group and the nation can 
be compared. Median p-values i-^) and hinges (^) are also desig- 
nated . \ 
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APPENPIX A 
CROSS-REFERENCE LIST 



Appendix A presents a tiross-referejice list from .xelease num-* 
ber" to NAEP numBer. Also, p-yalufes are listed for each exercise. 
Release numbers identify exercise placement within themes, and 
The FivBt Social Studies ^Aeeeeement: An Overview, Report OS^ii^-OO 
and the Social Studies TecHnicdl Report: Exercise Volume, Report 
03^SS-'20 are in release-number order. The cross-reference list 
can be used to identify which p-values relate to which exercises 
and to look exercises, up in The First Sociflt Studies Assessment: 
An Overview or Social Studies Technical Report: Exercise Volume. 



Release Numbers 

♦ . 

The following example illustrates how the release-number 
identifiqation system works. 



RS008A: 



RSO08A: 



RSO08A: 



RS008A: 



RSOO^: 



fhe first letter in the •vderftifier ijidicates 
that the exercise is released (R) or unrelea^sed 
(U) . 

The second letter indicates the area within 
which the exercise is classified. ' Thij5-^wii3r~~ , 
always be skills (S) , knowledg^,.^^(«T^or attitudes 
(A) . . 

The third letter>ii^icates the topic in this 
case ••obtaijving Information. 



Th^^Ht^xt two^ digits indicate the exercise place- 
^,^.-^nt with|.n a topic. 

. » 
Sometimes the last two digits are followed by 
a letter -r— A through F. These letter^^^^rtdicate 
that the exercise was one part of a multipart 
exercise. ' 



NAEP Numbers 

rjAEP nvunbers identify exercise placement within objective^nd 
subobjective. .The following example illustrates how tRiSy4ystem 
works. 

lOJ \' 



ERIC 



204003-234: The first number indicates the objective.. 

304003-234 ; The second and third numbers indicate the sub- 
* objective within the objective.^ 



304003-234: 



The next three numbers uniquely number the ^ 
specific exerpise within 'objective and sub- 
objective. " • V 



3^4003-234: 



The numbers following the dash irMicate the 



In 



age levels that responded to the exercise « 
this case, 13-year-olds, 17-y^ar-olds and ' 
, adults responded. If the exercise had also 
been given to 9-year-olds/ the indicator would 
include a "1." 



> 
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yeif 3 social ^studies 
:ross rbpehencb list: release number to nhep nombep^ 



R1!LEASE 
HaHBRR . 

DABOtA 

RABOIB 

OABOTC 

RABQ1D 

•RABOTE 

RAB02-02 

UA*B03-03 

RABoa*oa 

RAB05t01 
UAB06 
RIB07-01 
RAB08*01 
RAB09-03 
RAB10-10 
RAB11-01 
OAB12-01 
RAB13-02 
0AB1M 
0AB15-03 
RAB16-01 
RAB17-04 
OAB18-0i. 
UAB19 
RAB20-10 
0AB21 
RAR01-01 
'RAR02-0a 
OAR03-03 

•aARoa 

RA'P05-0a 
.aAR06 
RAR07 
RAR08-0a. 
0AR09-01 

oARib-or., 

^ RARl1-0a/\ 
RAR12A0^, 
RAR12Ba2 

RKB02 ' 
OK1503 j 
^ RKBOa / 
'QKBOS \ 
a^E06 \ 
RKB07 \ 
0KBO8 \ 
0KB09A \ 
• RK1?09B \ 
RKB09C \ 

QKBIO 
QKBH 



MABP 
JiaHBER 

506017-1 



506013- 
506015- 
5020ia- 
103002- 
505007- 
5J050-n- 
527a02- 
'103Q61- 
505009- 
501O07- 
501002- 
501017- 
501015- 
102002- 
527006- 
501011- 
503012- 
501010- 
503010- 
503015- 
502005- 
50.1009- 
5(1200^- 
5ft200a- 
502002^ 
502011- 
502012- 
502(n0- 
502013r 
502017- 
502007- 
502016- 

403017- 
403007- 
403013- 
403021- 
403005- 
403008- 
403010- 
403026- 
405010- 



234 

234 

34 

1 

1 

1 

123 
234 
234 
t 

12 

1234 

1234 

234 

234 _ 

34 

234 

34 

23 

34. 

123 

234 

234 

34 

34 ' 

234 

234 

234 

34 

34 

23t^ 

34 . 

1 
1 
1 
1 

234 
234 
234 
234 
234 



<— - NATIONAL. P-VAL05 

KG?. 9 AGE 13 * J^GE 17 



86.96 
72*67 
77*57* 
78.04 
80.76 



> 

ADULT 



98. 26 
78.^2 

79.62 



87.15 
27.42 
30. 18 
82. 17 



72.54 



83. j8 
43.87 
48.51 
8^.93 



/ 



404002-234 
403024-34 



64.01 


85.37 . 


60.35* 


56.56 


71.89 


- 85.03 




79..83 


62.30 


92.09 


88.4)8' 




ie'."48 


23.70 


. 20.39 


30. 38 


37.5'8 ' 


ttO.2.1 , 


67.66 






71.06 


83. 82 


89.40 


83. 19 


' •/84.0.4 


85.59 


71.66 


<':75.17 . 


59. 0<* 


.73.79 


• '89.77 


89.94 




78.85. 


78.35 


74.48 


•84.' 50 


76.92 




_89.32 


81.11 


55.22 


^50.56 






. 70.13 


^90.55 


87.28 


— 90r62 




57.87 


80.00 


72.70 


72.81 


79. 59 


77.18 


* 


80.52 


81.46 




80.64 


' 81.22 


63.88 


^ 78.13 


• ' 77.88 


59.36 


62.60 


. 55. 64 

4* 


40.59 


66. 12 


70. 57 . • 




57.49 


69.90 




81.59 


80.23 


53,46 


79.61 


71.97 . 




42.26 


55.96 , 




40.34 


•44.0 3 


47.18 


58.10 


74. '68 


64.83 


80.66 


76.50 


57.05 


81.24 


78.51 


79»J0 


537 . 34 


92.77 


65. t?8 


60. 26 


51.64 


40.77 


66.00 


52.47 


67.44 


78.34 


83.!»2 


20.29 


29. 66 


27.77 


27.16 


54. 99 ' 


"50.08 




25'. 94 


• 27.92 
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-PFLZASE 
NnHBER 

K 

RKE13 
PK'Jia . 

, 0KE1SB- 
0KE15C 
RKE15D 

'RKE16-03 
RKG01 
RKG02A 
RKG02B 
\HKG02C 
RK(;02D 
0KG02E 
UKG03 
RkG04 
RKG05 ^ 
UKG06 * 
4JirG07 

' RKGOfl 

^ RKG09 . 
RKG10 - 
0KG11 , 

" 0KG12 

_0Kfil3 

^'^GU 
RKG15 
0*G16 
RKG17-03 
RKG18-06 

. 0KG19 

' RKG20-03 
RKHOt * 
0KH02 
aKH03 
0KH04 
.RKH05 

. RfCHOe 
RKH07 
RKH08 
0KH09 
RKH10 
0KH11 
0KH12-03 
RKH13A02 
RKH13B02 
RKK13C02' 
RKH13D02 

'0KH14B 

RKHIttD 



TEAR 3 SOCIAL ST(M)IES 
CROSS REFBRSHCE LIST: RELEASE NUHBeJi TO AEITnUNBBR 



HA-EP 
NUMBER 

403032-^ai» 
403031-34' 
403011-234 
40300' -234 



406(J0l-34 

404017- 1 

404018- 1 



404020^1 

404021- 1 

404022- 1 

404027- 1 

404028- 1 

405031- 12 
40i*029-234 

404012- 1 

404013- 1 
404015-12 

- 404003-230^ 
404006r234, 
4 0'2011-3'4 
402012-34 
427001-1234 

404023- 1234 
405020-34 
405046-34 * 
40500 6-123 4" 

^ 405021-1 
405022*1 

405032- 2 
405040-1 
40501>^234 
<I0504V234 
405028-3 
405024-234 
405014-34 

"405037-34 • 
402015-34 
405045-1234/ 



405005-1^34 



< 

AGE 9/ 



„NmONAL P-VALUB 



/50.93 
/ 57.35 
/ 79.91 

68.33 
60.61 
« 71.93 
42.57 
37.37 
37.38 
39.85 
24.36 

, 89.22 
80.94 
- 22.19 



39.94 
47. 10 



39.77 
94.30= 
68.82! 

44. 74^ 
82.48< 



• 6.07 
7.90 
.08 

58.29 
90. 90' 
48.91 
82.5-3 

I 




ERLC^ 
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lU 



70.^4 6 



age) 17 

I 

51. *16* 
/21. 34 
44,64 
71.76 
59. 7t 
21.65 
79. 24 

52. J3 



> 

ADOLT 

56. UO 
30. 34 
55.06 
72.tt2 
72.62 
21 .40 
71.98 
51.49 



29.87 


33.74 


22.00 


54.21 


• 


• 


57.77 


'78.19 


65.82 


52.69 


60. 03 . 


46. 9e 




18. 84 


«0 . 3.8 


59.87 


' 43. 53 


44.73- 


71.06 


X7. 31 


75.09 


82.33'-' 


'84.63 




. 45.58 


39.13- 




29.58 


36.70 


67. 30 


78.73 


77.09 


45.92 




It 


49.57^ 


64. 02 


48.72 


77.22 


85.02 


. 78.55 


61. 21 


81. 98 


75.79 




89.06 


86.71 




, ' 38*75 


' 35.46 




32.41 


49.23 


17.81 


J4.71 


40.77 


33.97 


64.^01 


72.82 


.28 


1 .ia 


\ 06 


3.05 


7.. 40 


19.53 


62.83 


55. 43 


62.55 


97. &8 


98.77 


97.53 


56.64 


54.11 


60.81 


86.69 


85. 36 

• 


90.46' 




♦ 
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CROSS REPBPBNCB LIST: RELEASE NONBER. TO NKKP NDHBER 
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If ABP 




KdHBER 




405048-1234^ 


OK HI 5B 




HKH15C 




"0KB15D 




(IKH16 


•405007-1234 


fllCHI? 


405035-234. 


RKR18 


406009-1234 


aKB19 


405015-34^ 


HKP01 


402008-1 


1IKP02 


406010-1 


HKPOa 


406022-1 ' ' 


RKPM 


401004-234 


aKP05^ 


406020-234 


aKP06* 


406021-234 


okpotX • 


406033-234 


OKP07B 




0!CPQ7C 


/ 
/ 


OKPOTD 


/ 


HKP08A 


4Gf'6035-2 34 


BKP08B 


RKP08C 




RKP08D 




RKP09 


406006-234 


9KP10 


406023-2 


^KPII 


406005-3 


(IKP12 


406018-234 * 


RKP13 


406019-234 


OKPIfl 


406026-3 


fJKPIS 


*40.60 15^-2 34 


FKP16 


406011-23}! V 


'^KPI? 


406012-234 


RICP ^8k 


406017-34 


RRP18B 




RKP18C 




PKP18D 




RKP18B 




PICP19 


'201008-1 


nKP20 


406007-1 ^ 


FKP21-01 


40^006-234 


RSI01.-0 1 


2050^3-1 


IJSI02 


204r008-1 


0STO3 ^ 


204021-1 


RSICfa 


204020-1 


as 1,0 s 


205017-1 


RSI06 


205002-1 


rJSI07 


205a03-1 


fjsioe. 


,205004-1 


as 109 


204010-:234 , 


t'SIlO ' 


205008-234 ^ 


ft <;t 1 1 


20S0 ljn-234 


asii2 


205007-234 


RST13 


304006-234^^ 






• 


>- 

• 



9^.41 
97.27 

63.66 
66.90 
73.84 
^7.47 
71.3S 
69.49 
66.43 
46.57 











AGS 9 


AGE 13 


AGB 17 


ADOLT 


78.55 


96,59 


97.97 


^ 96.25 


19.^6 


34.84 


45. 57 


38. 81 


63.40 


74.78 


74*66 


65. 52 


86.04 


95.. &5 


96. 33 


92.46 


39.57 . 


64.61 


•85. 01 


81. 11 




67,15 


69.74 


80.81 


46.85 


76.45' 


91.76 


88. 46 






50. 22 


61-55 


35*92 








73 .82' 








57. 54 


1 * * 








* 49.46 ' 


7*1.. 64 


74.27 




39.14 


66.71 


66.23 




26.72 


37, 71 


63,89 




66.99 


82.94 , 


89. 19 




47.23 


64. 88 


70,20 




60.34 


87. 19 


' 8d.?7 




: 82.49 


'93. 93 


96. 34* 




71.34 


83.75 


79. 1 1 




" 71 .68 


89. 82 


95, 02 




73^43 


* 89. 37 


91.47 




77.05 


91. 45 


91.79 




63 •2& 


83.92 


78.23 




76.77 










48.80 


^ 52.32 




26.39 . 


^ 49.24 


45.73 




34.84 


70.93 


'61.85 






9.28 






30.28 


55;93 


6,5.47 




73.69 


89.44 


89r69 




17.05 


48.51 


59.66 






72.80 


74.42 






83.^15 


74,09 






73.57 


70.64 






62.59 


69.68 






90.05 


90.20 



105 



67.03 



83.65 



73.91 
81^11 
59.49 
56.72 
77.48 



85. 05 
86.93 
60.»4a 
79.81 
91.25 



n2 




68.59 



73.99 
80. 10 
76.35 
80. 13 
88.99 



SOCIAL STOOIBS 



4 CROSS RBPBRSNCK LIST: RELEASE HONBBR TO NACP KUNBBR 



RBLBASB 
. VaRBBR 

0SI1U 

0SI15 

RSI16 

fJSHTB 

aSI17C 

RSt17D 

06I17B 

Rspe 

tJSl'l9 , 

(ISI20A 

0SI20B 

RSI20C ^ 

RSl20D 

RSI21 

(fSI22 

Rsna 
osi.2a ' 

RSI25 
RSI26 
OS 1 27 
RSI28-01 
0SI29 

asi30 

RSI31-01 
RSI32-01 
RSI33-0T 
RS001-03 
»KJS002-01 
RSO03B0U' 
aSO03D02 
aSO03P02 
'tJSOOU-01 
RSO05-07 
RSO0fiA03 
aSO06B01 
RSO07-12 
RS008A 
0SO08B 
0SO08C 
RS008D 
RSa09A 
RS009B 
0§009C 
US009D 

msoio 

RS011 

SS012 
SO13-03 
aSOlUA 

rjsoi?B 

P.S01UC 
RS01UD 



KABP 
NQRBBR 

20U01 1-23U 
205006-23(1 
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